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In an essential and quite general setup, based on networks, we identify Schnakenberg's observables 
as the constraints that prevent a system from relaxing to equilibrium, showing that, in the linear 
regime, steady states satisfy a minimum entropy production principle. The result is applied to 
master equation systems, opening a new path to a well-known version of the principle regarding 
invariant states. Moreover, with the aid of a simple example, the principle is shown to conform 
to Prigogine's original formulation. Finally, we discuss analogies and differences with a recently 
proposed maximum entropy production principle. 
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A. Introduction 

The minimum entropy production principle (MINEP) 
asserts, using Klein and Meijer's words [1], that 

"the steady state is that state in which the 
rate of entropy production has the minimum 
value consistent with the external constraints 
which prevent the system from reaching equi- 
librium" . 

So worded, it is reminiscent of the inferential method that 
provides ensembles in equilibrium statistical mechanics, 
by maximization of the Gibbs-Shannon entropy — a mea- 
sure of ignorance of the microstate of the system — under 
suitable constraints. In an information-theoretic frame- 
work, constraints are pieces of knowledge the observer 
gains from the measurement of certain observables of the 
system, or macroscopic parameters that can be experi- 
mentally controlled. In the extremization procedure con- 
straints are introduced through Lagrange multipliers [5]. 

Not exactly so for MINEP. Its first proof as a closed 
theorem is attributed to Prigogine 0. In Prigogine's 
statement, owing to the applied thermo-chemical setting, 
knowledge of the noncquilibrium external constraints, 
such as temperature or chemical potential gradients, is 
granted from the start. Further generalizations of the 
principle always entail that constraints can be read off 
the physical setup of the problem. So, in his extension of 
the principle to density matrices [4], Callen recalls that 

"Prigogine showed that in the steady state 
which is reached when certain affinities are 
constrained to have definite values, all un- 
constrained affinities assume the values which 
minimize the entropy production function" . 

However, the environmental influence on a system might 
be a priori unknown, or difficult to decipher. In this pa- 
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per we do not assume previous knowledge of the nonequi- 
librium constraints, or affinities. As uninformed ob- 
servers, we look at the system, measure its fluxes and 
local constitutive relations, and ask which are the con- 
straints that impede relaxation to equilibrium. 



1. Scope and plan of the paper 

More specifically, this work addresses two technical 
questions: Which Lagrange multipliers should be intro- 
duced in the MINEP variational procedure? Which con- 
straints are implicitly encoded in the transition rates 
of master equation systems? For systems in the linear 
regime, the answer is found in Schnakenberg's theory 
of macroscopic observables [S], further supporting the 
point of view that his construction identifies the funda- 
mental, experimentally accessible observables of NESM 
(Non- Equilibrium Statistical Mechanics). When the lin- 
ear constitutive relations or probabilistic transition rates 
are known or measurable, Schnakenberg's affinities can 
be explicitly calculated. For chemical reaction networks, 
it is known that they coincide with chemical potential 
differences {6^. For this reason his analysis has mainly 
found application in biochemistry [71 |S] , where it plays 
an important role for the comprehension of free energy 
transduction. Recently it is finding growing applications 
to transport phenomena and molecular motors [H l9Ul2) . 
These works show how the seemingly rather formal the- 
ory makes direct contact with experimentally accessible 
problems in thermodynamics, such as bounding maxi- 
mum power efficiencies of nanomachines |12j . 

We first identifty the underlying degrees of freedom 
that are subject to constraints, spoiling the problem of its 
material content and considering bare fluxes of "informa- 
tion" to achieve the generality of equilibrium statistical 
mechanics j2]. For systems consisting of a finite num- 
ber of microstates, we identify Schnakenberg's affinities 
[5j as the correct macroscopic constraints. Schnakenberg 
introduced them for Markovian systems whose evolution 
is dictated by a master equation, but the construction 
can be generalized to any network of currents. Affini- 
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ties are defined as circuitations of nonconservative forces. 
Along with their conjugate "mesh" currents, they furnish 
a complete description of the steady state. 

As for most, if not all, constructive variational prin- 
ciples in NESM, the range of validity of the principle is 
the linear regime. Notice that we will assume the linear 
regime constitutive relations and not derive them from 
the principle of least dissipation, as is done in classical 
textbooks on nonequilibrium thermodynamics [131 Ch. 4 
and Ch. 5] . In particular, we will not distinguish between 
the dissipation function and the entropy production. 

Schnakenberg's network theory can be efficiently intro- 
duced in an algebraic graph-theoretical fashion. We will 
concisely provide all the necessary tools in Sec[B] in a 
self-contained manner. For more details, good references 
are Biggs's book [14 and Nakanishi's P[5]. The principle 
is formulated in Sec[Cj and then applied to Markovian 
master equation systems. This yields a proof to the fact 
that the steady state is a local minimum of the entropy 
production. We thus obtain by a very different method a 
result previously derived by Jiu-Li, Van den Broeck and 
Nicolis [16j , and more recently rediscovered in the frame- 
work of Large Deviation Theory by Maes and Netocny 
[T7| . These earlier results are discussed in Sec D where 
the relationship with Prigogine's original statement of the 
principle is also discussed. In fact, it turns out that the 
principle is perfectly adherent to Prigogine's formulation. 



The last subsection of Sec D is devoted to a comparison 
of our result with a formulation of the maximum entropy 
production principle due to P. Zupanovic, D. Juretic and 
S. Botric [15], which also deals with conservation laws, 
and might appear to be in contradiction — at least nom- 
inally — with ours, showing that the two principles are 
compatible. 

We prosecute this introduction with a simple physical 
example that should convey that circuitations are good 
nonequilibrium constraints. 



2. Circuitations as constraints 

Consider the classical problem of heat diffusion in an 
approximately one-dimensional inhomogenous conduc- 
tive rod, whose ends are put in contact with thermal 
reservoirs at slightly different boundary temperatures, 
Tb ^ Ta, while the body of the rod is isolated (see [121 
§3.1] and references therein). A temperature profile T(x) 
establishes. By Fourier's Law the induced heat current 
thorugh the rod is 



j{x) = -k{x)dT{x), 



(1) 



where k{x) is the thermal conductivity at x e [a, 6] and 
d = Qjdx. The following identity 



n 



J a 



k{x) 



dx = 



(2) 



is interpreted as a constraint on the currents, where we 
make use of the equivalence symbol 'e' to impose con- 



straints. Independently of the particular evolution equa- 
tion that the heat current satisfies, the configuration is 
said to be steady if at each point of the rod the influx of 
current balances the outflux, dj*{x) = 0, which implies 
j*{x) = const. 

The same result can be obtained by a different route. 
Let us define the local force as the right incremental ratio 

a(x)= lim ^ \x + Sx)-T \x) ^ ^e[a,b). (3) 

Sx^O+ Ox 

We assume that the system satisfies linear regime con- 
stitutive equations, that is, that forces and currents are 
small and linearly related. 



a{x) = £{x)j{x). 



(4) 



For this assumption to hold it is necessary that the tem- 
perature profile is approximately constant and the tem- 
perature drop between the extremities of the rod is suf- 
ficiently small with respect to its length, in such a way 
that to first order one can approximate the conjugate 
force as a{x) = -T~^dT{x), x + b, where Tav is the av- 
erage value of the temperature [TH [20] . The local linear 
regime coefficient then reads £{x) = T~^k{x)~^. The en- 
tropy production 



/ j{x)a{x)dx, 

J a 



(5) 



is then a quadratic functional of the currents. We require 
a to be stationary, that is Sa = 0, with respect to all pos- 
sible current profiles that are consistent with constraint 
([2]). Introducing one Lagrange multiplier A, we calculate 
the variation 



£{x)j{xfdx-2\ f"^^dx 

Ja Ja k(x) 



k{x) 



0, 



(6) 



leading to a uniform stationary current j* = ^T^y The 
value of the multiplier is fixed by substitution into Eq. ([2| : 



J 



/ K^r' 

J a 



dx 



(7) 



The above solution corresponds to a minimum of tr, and it 
coincides with the steady configuration of currents. We 
conclude that the steady state is the minimum of the 
entropy production among nearby current profiles that 
are compatible with the external constraint. Notice that, 
while in the NESM literature "stationary" and "steady" 
are synonyms, we prefer to use the former when referring 
to the extremal solution of a variational problem, and 
the latter for a configuration of currents that satisfies 
the continuity equation. 

The problem of heat-conduction and the minimum en- 
tropy production principle in a rod has been widely de- 
bated [20l[2T] , with arguments revolving around the onset 
of the linear regime. While the exact MINEP solution 
displays an exponential dependence on the position, it 
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can be shown that under reasonable experimental condi- 
tions the deviations between the rigorous MINEP tem- 
perature profiles and the steady profiles are small. In this 
work we are not interested in the careful identification of 
the range of validity of Eq.Q, but rather in the forth- 
coming geometrical interpretation of the constraint as a 
circuitation: So we will always assume that our systems 
admit a well-defined linear regime. 

At a steady state as much heat is absorbed by the 
colder reservoir, as much has to be poured in by the hot- 
ter one. If we ideally short-circuitate the rod, bringing 
the end-points to coincide, the linear system is mapped 
to a unicyclic system, with a conserved heat fiux through 
the whole ring. Due to the discontinuity of T{x) ai x = a, 
the affinity is not a conservative field (i.e., it is not the 
derivative of some potential in all of its domain). How- 
ever, we can still integrate it to get the constraint 

(f a{x)dx = (8) 

Jimg la if) 

which in the linear regime is equivalent to Eq.([2|. When 
the boundary temperatures coincide, that is, at equilib- 
rium, the affinity is indeed an exact form and the circu- 
lation vanishes. Thus there exists a correspondence be- 
tween "topological" circuitations, nonconservative driv- 
ing forces, and the onset of nonequilibrium behavior. 

Schnakenberg's intuition was that circuitations of non- 
conservative fields are the fundamental observables that 
keep a system out of equilibrium. We push this further 
claiming that, in the linear regime, they are the con- 
straints to be imposed to the MINEP procedure. 

As soon as one abandons the 1-dimensional case, one 
incurs great difficulties. In particular, steadiness dj* = 
does not imply a uniform current distribution, and one 
realizes that the problem is of geometrical nature, in- 
volving differential forms, topology, etc. However, on a 
discrete state space Schnakenberg's intuition can be effi- 
ciently put to work. 

B. Schnakenberg's theory 

J. Schnakenberg's seminal paper ^5j is mainly known 
for the identification of the total entropy production (EP) 
of a Markovian system, although that element was instru- 
mental — and actually inessential — to the formulation 
of a theory of macroscopic observables as circuitations of 
local forces. 

The theory is synthesized below, starting with a sim- 
ple example. We then introduce all the definitions and 
hypothesis that are strictly necessary to the theory. 

1. An example 

Consider a discrete state space consisting of four states, 
which exchange between one another some physical quan- 
tity, be it mass, energy, charge, spin etc., at certain rates. 



For sake of abstractness, we will suppose that these phys- 
ical quantities are coded in bits, so that from the compar- 
ison of two nearby snapshots of the system an observer 
will be able to measure a certain flux of raw "informa- 
tion" at a certain time, as is shown in Figjl]i. Here the 
states of the system are depicted with vertices of a graph, 
and the channels of communication with oriented edges 
e connecting the states. Currents je might have positive 
or negative sign, according to the direction of the flow — 
concordant or opposite to the edges' orientations. No- 
tice that not all states need to be connected. We further 
suppose that the currents are induced by some conjugate 
local forces Ce, which have the same sign, and finally we 
introduce the EP, 

<^[j, a] = jifli + ^202 + iaoa + j4a4 + jbO-b- (9) 

A comment is needed on the usage of the scale words. 
Schnakenberg referred to je as a microscopic current, 
and to the observables we are going to build as macro- 
scopic. However, later developments in the stochastic 
thermodynamics of master equation systems (see [2 2) and 
references therein) allow us to identify single-trajectory 
analogs of thermodynamical quantities, such as currents 
and entropy production, whose averages over paths re- 
turn je, cr, etc. This suggests to reserve the word "micro- 
scopic" for this further layer, and to adopt "mesoscopic" 
for je and Og, irregardless of their spatial dimension. 

The configuration of currents is steady if the total in- 
fiow at the nodes is null, yielding the conservation laws 

= Ji I J2 = Js' ii +.?5 =J2' is ~ ~ Jb- (10) 

One of them is redundant. The others allow us to express 
all of the steady currents in terms of, e.g., j^ and 
Replacing the solution in the expression for the EP yields 

A^ 

^ ^ ^ * ^ 

<^[j*,a] = jl (01 + 04-05) +^3 (02 + 03 + 05) . (11) 

Overbraces are used to define the macroscopic forces or 
affinities^ which are conjugate to the fundamental cur- 
rents Jl = jl and J3 = j^ . The affinities are sums of the 
local forces along oriented cycles of the graph. 

The linear regime constitutive relations are now as- 
sumed: currents and forces are related by = iej*! with 
£e positive local linear response coefficients. We obtain 
for the macroscopic forces 

A' = iij*i + edl - = (^1 + 4 + 4) Jl + fZ)J3 

(12a) 

^33 ^31 

A' = ^2j2+%3+4i5 = (4 + 4+4) J3 + C^)Jl- 

(12b) 

The right-and side defines the macroscopic linear re- 
sponse coefficients, which satisfy Onsager's reciprocity 
relations. 
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FIG. 1: (a) Above: an oriented graph. Below: a spanning 
tree, (b) Dotted: a generating chord. Below: its conjugate 
fundamental cycle, (c) The same. 



We gather that the conservation laws at the nodes can 
be used to express the EP in terms of a certain number of 
boundary currents and of conjugate affinities, which are 
circuitations of the local forces along oriented cycles of 
the graph. Assuming the linear regime constitutive rela- 
tions yields a symmetric linear response matrix between 
affinities and fundamental currents. 



2. Graphs, cycles, fundamental sets 

Consider now a finite microstate space V , with \V\ nii- 
crostates labeled by i, j, . . ., which are pairwise connected 
by \E\ edges e in the edge set i? of a graph G = {V,E). 
Assign an arbitrary orientation to the edges, which is the 
choice of tip and tail vertices; -e depicts the inverse edge. 
The incidence matrix d, with entries 



+ 1, if <- i 
-1, if 

0, elsewhere 



(13) 



contains all the information about the topology of the 
graph, with the exception of irrelevant loops (edges whose 
tip and tail coincide). Its rows are not independent, 
as each column adds up to zero. It is a basic graph- 
theoretical fact that if d cannot be arranged in blocks, 
than it has rank \V\ - 1. The assumption, to which we 
stick, corresponds to the choice of a connected graph, i.e. 
a graph whose vertices can all be connected by paths. 

From a graphical viewpoint, cycles c are chains of edges 
with no boundary: each vertex it touches is the tip and 
the tail of an equal number of edges of the cycle. To give 
an algebraic characterization, notice that, by definition, 
cycles belong to the kernel of d; they form the cycle space 
C. The dimension of C is called the cyclomatic number. 
By the rank-nullity theorem, the number of independent 
rows and the dimension of the kernel of a matrix add to 
the number of its columns, rk 9 + null d = \E\. Hence the 



cyclomatic number is 

\C\ = \E\-\V\ + 1. 



(14) 



Cycles are simple when they do not have multiple com- 
ponents, overlapping edges nor crossings [32' . 

Among all possible basis of C, we focus on fundamental 
sets, which are so constructed (see Figjl]). Let T ^ E he 
a spanning tree of the graph, i.e., a maximal set of edges 
that contains no cycles. Spanning trees enjoy several 
properties; among others, they touch all the vertices, and 
consist of |y| - 1 edges. An edge that does not belong 
to the spanning tree is called a chord. There are |C| 
chords. Adding a chord to a spanning tree generates a 
simple cycle c", which can be oriented accordingly with 
the orientation of Cq. The fundamental set of cycles so 
generated can be proven to be a basis for C. The proof 
roughly goes as follows: Any chord belongs to a cycle. By 
construction, no two fundamental cycles share a chord, 
so that they are necessarily independent. Finally, a set 
of |C| independent vectors in C constitutes a basis. 

This is the central technicality behind Schnakenberg's 
theory. Let us resume: Cycles of a graph form an integer 
vector space; they span the kernel of the incidence ma- 
trix. Adding chords to a spanning tree generates a basis 
of simple cycles c" . The vector representative of a simple 
cycle has components 



+ 1, if e belongs to cycle c" 
-1, if - e belongs to cycle c" 
elsewhere. 



(15) 



A basis which is built out of a spanning tree is said to 
be a fundamental set. Fundamental sets satisfy two very 
important properties: i) Each simple cycle comes along 
with a preferred generating edge Ca, called a chord, which 
belongs to the complement of the tree; ii) Each chord 
belongs only to the cycle it generates. 



3. Macroscopic observables 

Let the mesoscopic currents je be real edge variables, 
antisymmetric by edge inversion, j_e = -je- Similarly 
defined are the mescocopic forces a^. , which are required 
to bear the same sign as their conjugate currents je. The 
entropy production is the bilinear form 



(16) 



In general, one will assume that currents and forces are 
interdependent, in such a way that forces vanish when 
currents vanish. Local linear regime holds when currents 
and forces are linearly related in a local way (that is, edge 
by edge) by 



(17) 



where 1^ - i-e is a positive symmetric edge variable. The 
linear regime holds to first order for small currents and 
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forces. Notice that by reasons of symmetry the next lead- 
ing order in this expression is third order in the currents. 

The collection of currents j* is said to be steady when 
Kirchhoff 's law is satisfied at each node, 



(18) 



or in matrix notation simply dj* = 0. Hence j* belongs 
to the kernel of d, and can be decomposed in a basis of 
fundamental cycles 



J 



(19) 



In particular, since chord Bq belongs only to cycle c", the 
macroscopic internal current Jq, coincides with the cur- 
rent flowing along chord e^. Replacing the solution 
in the expression for the entropy production yields 

a* = Y,J"A"' (20) 



where 



(21) 



is a macroscopic external force or affinity, obtained as 
the circuitation of the mesoscopic forces along cycle c" . 
Macroscopic currents and affinities are conjugate vari- 
ables which completely characterize the steady state. 
When all affinities vanish, the system is said to satisfy de- 
tailed balance, or to be equilibrium. In the linear regime, 
replacing the solution to Kirkhhoff 's law ( 19 1 into Eq.( 17 ) 



and summing along oriented edges of a cycle yields 



A" 



a 8 



(22) 



where the linear response matrix L"^ = Y,e^ec"c^, being 
manifestly symmetric, satisfies Onsager's reciprocity re- 
lations. This was one main clue that led Schnakenberg to 
promote macroscopic currents and forces to fundamental 
observables. 

The linear response matrix can be combinatorially con- 
structed by taking all response coefficients £e that be- 
long to both cycles and c^ , with a plus or minus sign 
whether the cycles' orientation is either concordant or op- 
posite along edge e. This kind of matrices is well known 
in graph theory and in Feynman diagrammatics |15| . One 
property that is relevant to our discourse is that its de- 
terminant is always non-null (but for very trivial graphs) , 
which guarantees invertibility of expression (22 1. 



C. Minimum entropy production principle 

In this section we prove that, in the linear regime, 
steady states minimize entropy production among all 
states that are compatible with the external macroscopic 
circuitations of the mesoscopic forces. We then special- 
ize the result to master equation systems, showing that 
in the linear regime the steady probability distribution 
minimizes the entropy production. 



1. General statement 

According to Schnakenberg's theory of nonequilibrium 
observables, the external constraints that force a system 
into a non-equilibrium steady state are the macroscopic 
external forces. We will now extremize entropy produc- 
tion with respect to mesoscopic currents in the linear 
regime, using Schnakenberg's affinities as constraints. 



A"EA"[j]=^C^4je+0(/), 



(23) 



where A"' is a fixed, "observed" value of the affinity. The 
EP is the quadratic form 

4j] = E4je+0(/). (24) 

e 

We introduce Lagrange multipliers and vary 



_S_ 

We 



a[j]-2ZK(A'^[j]-A'^) 



0. 



(25) 



Multipliers Aq, are to be determined by replacement of 
the stationary solution into ( 23 ) . The calculation is easily 
carried over, yielding 



(26) 



Stationary currents are linear combinations of a cyclo- 
matic number of boundary terms Aq.. We now prove that 
the latter are in fact the macroscopic currents conjugate 
to the constrained values of the affinities. Fixing the La- 
grange multipliers we get 



A" 







^L"^A 

/9 



/3' 



(27) 



where we recognized the linear response matrix. This 
relation can be inverted, showing, after Eq.(22|, that Aq. 



is the steady current conjugate to the measured value of 
the affinity A". The second variation 



5a 



-2E' 



(28) 



yields a positive Hessian matrix, which guarantees posi- 
tive concavity. 

We thus conclude that the stationary configuration of 
currents that in the linear regime minimizes the entropy 
production with constrained macroscopic forces, satisfies 
Kirchhoff's conservation law. From a dynamical point of 
view, if under some ergodic hypothesis the steady state is 
asymptotically reached over the long time (as is the case, 
for example, for Markovian systems), one can conclude 
that a nonequilibrium system tends to relax to a state 
of minimum entropy production, compatibly with the 
macroscopic external forces that prevent it from reaching 
equilibrium. This echoes Klein and Meijer's phrasing. 
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2. Master equation systems 

Up to this point our main variables have been the 
currents, whose nature and origin was left unspecified. 
When dealing with Markov processes the object of in- 
terest is a normalized probability distribution p on the 
vertex set, which we will call a state of the system. Prob- 
ability currents are defined in terms of it as 



iij[p\ = w^jPj-WjiPi, 



(29) 



where the w^ 's are positive time-independent transition 
rates between states, with the physical dimension of an 
inverse time. The master equation dictates the evolution 



dt 



p{t) = Lp{t) = -dj[p{t)l 



(30) 



where L is the Markovian generator. Its solution is 
p{t) = e'^^po for any initial state po- We assume that 
the graph G is connected (that is, that there exists a 
path between any two vertices) and that transition rates 
are non-null in both directions along its edges. Under 
these mild assumptions, there exists a unique invariant, 
or steady, state p, Lp = 0, which is approached at late 
times. 



Pit) 



(31) 



independently of the initial distribution. Notice that the 
invariant state is uniquely determined from knowledge of 
the system's transition rates, and in fact there exists an 
explicit (but complicated) combinatorial expression for 
it, which is unnecessary for the present discussion [5]. 
The conjugate force along edge e = i <- j is defined as 



,[p] = ln- 



WjiPi 



(32) 



and it is diniensionless. By the Handshaking Lemma we 
can replace the sum over edges with one-half the sum 
over neighboring sites, yielding the EP 



(33) 



The motivation behind definition (32), also due to 



Schnakenberg [5], is that the entropy production is nat- 
urally split in the time derivative of the Gibbs-Shannon 
internal entropy S'[p], and a term that quantifies heat 
exchange with the environment, yielding an entropic bal- 
ance equation that is generally widely accepted, as it is 
the mesoscopic counterpart of the first law of (stochastic) 
thermodynamics along single trajectories [22 . 

The main peculiarity of Def . ( 32 ) is that affinities turn 



out to be independent of the state of the system p(t), 
and thus time-independent. 



A" = lnn 



We 



(34) 



This property was another important clue that led 
Schnakenberg to interpret them as environmental con- 
straints. Remarkably, this further entails that, for a fixed 
set of transition rates, variation of the probability dis- 
tribution p in any case preserves all of the macroscopic 
affinities: We do not need to impose any constraint at 
all, as long as we stick to the linear regime. 

Let us then set up the linear regime. Consider a set of 
equilibrium transition rates w^j, whose steady state p^ 
satisfies detailed balance 



1, 



(35) 



which by Kolmogorov's criterion is known to hold if and 
only if all of the affinities vanish. The linear regime is 
attained when perturbing the equilibrium generator to a 
non-equilibrium one, L'^ , and at the same time consid- 
ering a probability distribution p'^ which is only slightly 
apart from the equilibrium steady state. 



p\ = {^ + m)P'°, 



(36a) 
(36b) 



where we suppose that all the e's and ry's are of infinites- 
imal order e. Let p"^ be the steady state relative to gen- 
erator L^. It can be shown [17] that p"^ - p^ is of order e, 
and consequently so is p'^ - p^ . Expanding the forces and 
the currents we obtain 




(37a) 
(37b) 

The r.h.s. of Eq.( |37a[ ) furnishes the linear response coef- 
ficient, £ii = (w'^^pI)^ , which by Eq.(35l is indeed sym- 



metrical under edge inversion. Notice that both forces 
and currents are of order e; entropy production is of or- 
der e^. 

In the linear regime local forces and currents meet 
all the requirements that are necessary to formulate the 
MINEP principle proven above. On the other hand, 
macroscopic constraints are independent of the proba- 
bility distribution. To conclude, we need to prove that 
the following variational problems are equivalent: 



Sa 



o 



Sa 
Tp 



0. 



(38) 



Using Eq.(33) and Eq.(37a), we can write the variation 



with respect to pk as a linear combination of the varia- 
tions with respect to the currents: 



Spk 



(39) 



Since variation of p preserves the affinities, we also have 



Mj] 



Spk 



Spk 



(40) 
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Whent the r.h.s. vanishes, so does the l.h.s.. Hence the 
left-to-right implication in Eq.( |38| can be drawn, which 
suffices to prove that the MINEP principle for master 
equation systems follows from ours: the invariant state 

is a local minimum of the entropy production among 
nearby probability distributions. Notice that we cannot 
continue our conclusion where r/ is no longer small. So we 
might expect that, even for near-equilibrium transition 
rates, there might exist a landscape of minima of the 
entropy production besides the invariant state. 

For sake of completeness, notice that the inverse impli- 
cation in (38) also holds. We need to make sure that the 



linear span of the variables is the same, in order to avoid, 
for example, that negative curvature directions of possi- 
ble saddle points be out of the span of the probability 
distribution, but within the span of the currents. In such 
a case, one would conclude that certain configurations of 
currents are extremal without being able to inspect all 
possible configurations. A qualitative argument goes as 
follows. There are \E\ currents, subject to a cyclomatic 
number of linear constraints, and \V\ probability entries, 
subject to one linear constraint, namely normalization. 



From Eq.(14| and from the fact that currents are linear 
in the probabilities, it follows that the linear span of the 
two variations has the same dimensionality: Hence they 
cover the same small neighborhood in the space of current 
profiles, near the equilibrium steady state. There is one 
last subtlety involved with this: Probability densities live 
in a simplex < < 1, rather than a vector space, which 
for small-enough rates would make even small currents 
out of reach. This is not a true limitation, as transi- 
tion rates are defined up to the conventional choice of an 
unit measure of time, which of course does not affect the 
generality of the principle |33j . 



D. Discussion: relationship to previous results 

The first paragraph of this section is devoted to trib- 
uting Prigogine's insights. Our proof of MINEP for mas- 
ter equation systems is a new path to an old result; we 
then briefiy credit the two approaches we are aware of. 
We conclude with a discussion of a formulation of the 
maximum entropy production principle that also involves 
Kirchhoff's equations. 



1. Prigogine 

I. Prigogine's proof of MINEP |3j, shaped upon chem- 
ical systems, is based on an assumed splitting of the EP 
into a matter flux term and a heat flux term. 



(T = JthAth + JmAr, 



(41) 



Steadiness is equivalent to the requirement that matter 
currents vanish, J,„ = 0. Hence EP at a steady state 
consists only of heat fiux contributions. 



Bridging to our abstract setup, we might interpret heat 
currents and inverse temperature gradients respectively 
as Schnakenberg's internal currents and external forces 
(this is precisely the case in the example discussed in Sub- 
Sec. I A 2 1. Pushing this identification out of the steady 



state, the question arises whether there exist conjugate 
observables analogous to "matter currents" and "pres- 
sure gradients" that would allow an analogous splitting 
in terms of Schnakenberg-type observables. The answer 
is in the affirmative. In |23| , the author provides a com- 
plete set of observables, complementing Schnakenberg's 
with internal forces A^^ and external currents , in such 



a way to bring EP to the form 



(42) 



The new observables are again built as linear combina- 
tions of mesoscopic observables along certain subgraphs. 
External currents vanish at a steady state. 

A review of the construction and its detailed proper- 
ties goes beyond the scope of this article. Let us hint at 
it by finalizing the special case treated in SubSec. | B 1| 
Basically, we want to rearrange Eq.([9| so to have cy- 
cles emerge. Since the new expression should reduce to 



Eq.(ll) when the conservation laws (10) hold, regardless 



of the value of the local affinities, we are indeed able to 
collect the currents in a profitable way: 



ji (ai +04-05) 

J* 



+ js (02 + as + as) 



+ 02 (j2 - js) + a4 (j4 - ji) + a,5 (js + ji - ja) . (43) 

The macroscopic external currents J^,J'^,J^ vanish at 
the steady state, as does Jm in Prigogine's approach. 



Notice that index a in Eq.(42) ranges over 1,3, index 
ranges over 2,4,5, and that the alternating index posi- 
tioning is crucial to the identification of the diverse ob- 
servables. Exploiting the linear regime local constitutive 
relations, one obtains 



(44a) 
(44b) 



which pairs with Prigogine's Eq.(6.2). Direct calculation 
of the coefficients (which we leave to the reader) shows 
that the reciprocity relations are fulfilled. Now the rea- 
soning follows along the same tracks as Prigogine's. Vari- 
ation with respect to the mesoscopic observables, at con- 
stant external affinities, can be replaced with variation 
with respect to the internal forces 

5 

o . 

5A., 



6 

5a 



(45) 



Replacing Eq.s (44) into Eq. (|42j) and varying, 

5(7 



5A,, 



2(r^A" + r^''A^) = 2j'' = o, 



(46) 
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yields vanishing external currents. We thus conclude 
that our approach is completely superimposable on Pri- 
gogine's phenomenological derivation, adding to it an ab- 
stract and quite general definition of the constraints. 



2. Jiu-Li and coworkers, Maes and coworkers 

The problem of extending Prigogine's theorem to a 
statement regarding populations, probability distribu- 
tions or density matrices was raised and undertaken al- 
ready by Klein and Meijer [1] with a specific model, and 
by Callen [4j in a quantum mechanical setting, in which 
a number of fixed forces are assumed [see Eq. (39)]. 

Later, the Brussel school delved into the problem of 
establishing stability criteria for nonequilibrium steady 
states [m Sec. 3. 5]. Along this line of research, Schnaken- 
berg's expression ( 33 ) for the EP of a Markovian system 



first appears in the work of L. Jiu-Li, C. Van den Broeck 
and G. Nicolis [1^], who derived the MINEP principle for 
probability distributions evolving under a master equa- 
tion in a very straightforward manner, which we now 
synthesize. The time derivative of a local force is 



a^J [p] 



El 



Pi' 



(47) 



Writing the linear regime expression for the entropy pro- 
duction in terms of the affinities 



IE 



(48) 



and taking its time derivative, we obtain 



i,j ^ij Pj i,j Pi i P' 



Since ct < 0, the EP decreases in the vicinity of the steady 
state toward the steady state. 

More involved is the approach of Maes and Netocny 
[T7j, who considered the large deviation rate function P 
of the occupancy empirical distribution 



np] 



■ lim — log P 



(50) 



Here is a single jump-process trajectory from time to 
time T, and P is the probability measure over trajecto- 
ries. Maes and Netocny proved the stronger result that, 
near equilibrium, in the leading order the rate function 
P[p] is equal to one- fourth the entropy production dif- 
ference cr[/o] - cr[^'] between state p and the invariant 
state. Since upon the above assumptions, on connect- 
edness and non- vanishing rates, Markovian systems are 
known to converge to the steady state, and since, by the 
law of large numbers, the steady state p.^ is a global min- 
imum of the rate function, one concludes that it is a local 
minimum of the entropy production. 



3. Zupanovic and coworkers 

The striving for variational principles in NESM has 
a long and contrived history. In particular, another, 
less familiar, variational principle has been proposed 
that should characterize the behavior of non-equilibrium 
systems: the maximum entropy production principle 
(MAXEP). There are at least as many formulations of 
MAXEP as there are of MINEP. Arguably, the apparent 
clash between these two instances is due to the fact that 
they apply to distinct scales and regimes, and employ 
different notions of "state". There is a vast literature 
that tries to sort out the matter [25] . and by no means 
do we mean to be exhaustive. However, we need to put 
our principle in contact with some instances of MAXEP 
in order to appreciate their relative significance. 

It was Jaynes's conviction that [55] "there must ex- 
ist an exact variational principle for steady irreversible 
processes" and that such principle should capture con- 
servation laws: "we should rather take the conservation 
laws as exact and given, and seek a principle which gives 
the correct phenomenological relations" . Jaynes thought 
that reversing this logic would also reverse the principle: 
"perhaps the exact phenomenology is the one that has 
maximum entropy production for prescribed exact con- 
servation laws" . So, Jaynes's expectation was that con- 
servation laws and constitutive equations should fit in the 
same picture, under the aegis of one unifying maximum 
principle. This supposition informs Gyarmati's research 
[l3| Par. V.3], as he claims that "the principle of mini- 
mum production of entropy is not an independent princi- 
ple [...], but rather is only an alternative reformulation 
of the Onsager principle valid for stationary cases" . 

In this respect, P. Zupanovic, D. Juretic and S. Botric's 
proposition is more closely related to our principle, as it 



(49) 

deals with Kirkhhoff 's current law (|18|) and Kirkchhoff 's 



loop law (21) on networks. It is to this work that we 



mainly refer in the following. 

Suppose we do not know the system's constitutive 
equations, but that we do know that entropy (in the form 
of heat) is dispersed into the environment at a rate 



(51) 



which is called the dissipation function. This is the case 
for electrical circuits, where ie plays the role of a resis- 
tance. Entropic balance then requires 



a - uj ■ 



0. 



(52) 



This is particularly reasonable for an electrical circuit, 
where oj is the electric power and a the heat flux [TB]. 
Finally we extremize entropy production, varying with 
respect to the currents, and imposing constraint (52), 



[o- + A((T - w)] = 0. 



(53) 



We obtain Oe = 2A/(1 + A) £eje- The value of the multiplier 
is set by replacing the extremizer in Eq. ( 52 ) , which yields 
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A = 1, a stationary value a* = uj and the desired meso- 
scopic phenomenological, = leje- Taking the second 
variation we obtain a negative hessian, hence a concave- 
down paraboloid, hence we front a maximum entropy 
production principle. 

Variational principle ( [53| is discussed by Martyusheva 
and Seleznev [25'i Eq. 1.16], where it is introduced as 
Ziegler's principle, and again by Zupanovic and cowork- 
ers [371 Eq. (9)] in a follow-up paper on the relation 
between MAXEP and the principle of least dissipation: 
In fact, the procedure is but a restatement of Onsager's 
least dissipation principle, which in its original form sim- 
ply states that a - uj should be maximum 28 1 . 



Embedding Kirchhoff's current law p8| into Eq.(53) 



(5X 



■[(1 + A)^J„A"-A^L"^J„J0] 

a a,l3 



(54) 



or, equivalently, constraining the solution to the vari- 
ational problem (53) on the dj = shell, leads to the 
identification of circuitations A" = E/3 L"^ Jp as the phe- 
nomenological conjugate variables to the currents. This 
realization of MAXEP does indeed reproduce Jaynes's 
expectation that the reversed logic should yield the cor- 
rect phenomenological laws. The MAXEP of Zupanovic 
et al. is in a sense complementary to our MINEP, repro- 
ducing the macroscopic Onsager's relations. With one 
specification; The MAXEP principle does not imply that 
"currents in a linear planar network arrange themselves 
so as to achieve the state of maximum entropy produc- 
tion" . That is due to the minimum entropy production 
principle. 



E. Concluding remarks 

Some of the hypothesis upon which we derived the 
principle can be relaxed. Working in a differential- 
geometric setting should allow us to extend the principle 
to continuous systems. In this context, a result similar 
to Schnakenberg's decomposition has been obtained by 
Jiang and the Qians [29j for topological currents, such 
as those that flow along the two fundamental cycles of a 
torus. The task is then to extend to nontopological cur- 
rents, through lattice discretizations and limiting proce- 
dures. One problem appears at the horizon: As the dis- 
cretization becomes more and more refined, the number 
of cycles tends to infinite, becoming non-dcnumerable in 
the continuum limit. This clashes with the physical in- 
tuition that nonequilibrium constraints should be a few 
boundary conditions that are experimentally accessible. 
For physically relevant systems, symmetries might have 
a role in the reduction of the number of affinities. 

The condition of locality can also be relaxed, consider- 
ing the more general mesoscopic phenomenological linear 



response relation 

ae = E^e/j/, (55) 
/ 

where (^e/)e./ is required to be a positive symmetric ma- 
trix. Definitions and proofs become only slighly more 
complicated by considering (55) in place of (17), with 



the only exception of detL i= 0, whose proof might be 
nontrivial. 

As to the hypothesis of linear regime, in our formu- 
lation the assumption seems to be unavoidable if one 
chooses affinities as nonequilibrium constraints. The pos- 
sibility is open that better observables might allow for a 
departure from the linear regime. There exist many in- 
stances of variational principles in NESM, most of which 
can be traced back to Onsager's least dissipation ad Pri- 
gogine's minimum EP, with their own, and different, in- 
clination. However, to the author's knowledge none truly 
departs from the linear regime, at least in an operational 
sense. So, in this respect our principle is no exception. 

Our extremization procedure is based on the identifica- 
tion of the fundamental macroscopic observables which 
keep a system in a nonequilibrium steady state. The 
setup is quite general and can in principle be adapted to 
any system that allows a local conservation law. It can be 
applied to master equation systems, where its robustness 
can be tested against well-known results. It is shown 
to provide an abstract setup where Prigogine's origi- 
nal statement sits comfortably, provided that we have 
a mesoscopic substrate. So, while the principle per se is 
no novelty, the procedure and its generality are. 

While the hot topic of NESM are, of course, fluctu- 
ations, there is a priori no fluctuating character in the 
principle we have formulated: It is purely geometrical, 
as one can show by recasting the construction in the lan- 
guage of discrete differential forms [30] • 

Coming to a conclusion, we suggest that the search for 
an extremal functional is as important as the identifica- 
tion of constraints of physical relevance. This might be 
a good guiding principle, for example, in the search of 
a maximum entropy principle: While MAXENT can be 
constructively employed to derive equilibrium ensembles 
^2j, to our knowledge a similar application to nonequi- 
librium steady states is still lacking. The possibility is 
open that giving to Schnakenberg's affinities the correct 
weight might allow to derive as useful tools of calculation 
as are equilibrium ensembles, fulfilling Jaynes's expec- 
tation that "essentially all of the known results of Sta- 
tistical Mechanics, equilibrium and nonequilibrium, are 
derivable consequences of this principle" [3T] . 
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